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ABSTRACT 

A study examined the effectiveness of a me tacogni t ive 
intervention that concentrated on eight subprocesses of writing and 
on executive procedures according to an "Orchestra Model" of text 
production. Subjects, 90 tenth-grade students, participated in the 
intervention which lasted for about six months and consisted of about 
60 lessons. The intervention consisted of process-oriented and 
product-oriented training. A series of seven tests and evaluation 
procedures were used before and after the intervention. Results 
indicated that subjects in the intervention group paid significantly 
more attention to the analysis of the writing task and the 
construction of semantic deep structure. Other improvements concerned 
the imposition of a chronology on the semantic deep structure; the 
repertoire of external representation means for representing 
intermediate results of the text production process; and the 
evaluation of the evolving text. Subjects of the intervention group 
not only possessed more elaborate declarative knowledge, but they 
applied it in real writing situations as well. (A figure illustrating 
the orchestra model of text production and four figures of data are 
included.) (RS) 
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1. Abstract 

During the last one and a half decades writing research has become a more and more important 
field in educational research (e.g. JECHLE 1992). Almost all of the writing research is related to 
research in metacognition (e.g. WINTER 1992). Our own research in writing (BAER 1989, 1992, BAER et 
al. 1993) is divided into three parts. In its theoretical part we developed a writing model which we call 
the "Orchestra Model" of Text Production. In the diagnosis part we investigated the nature of 
different text production abilities of grade 5 and grade 9 students, and of adults. It is furthermore a 
diagnosis of good and poor writers' differences within each of these three age groups. The study 
which is presented consists of an intervention that we developed on the basis of the theoretical and 
the diagnosis part. The theoretical part gives an idealistic understanding of the different 
subprocesses of writing and the coodination among them, while the diagnosis provides a realistic 
understanding of what writers really know of how to cope with writing tasks. Those aspects, which are 
to be considered as typical weaknesses, became the focus of the intervention. 
In the process-oriented training of the intervention we concentrated on 8 subprocesses of writing 
and on executive procedures, according to the "Orchestra Model" of Text Production. The 
product-oriented treeing provided subjects with main characteristics of exposilory and 
argumentation type of text according to BONATI (1990). Different measurements show that the 
intervention was successful. The subjects' improvement consists of a much bettei declarative and 
procedural metacognitive knowledge of text production. 



2. Theoretical Background 

The "Orchestra Model" of Text Production (OMOT) consists mainly of four main components, a test 
component as well as an executive component (see below). While the "E xecutive Xommo e nf 
coordinates the main and test components, the component 'Task Analysis" analyzes the text 
production task with regards to the pregiven requirements and conditions to produce the text. The 



^ 1 TexProF stands for Text Production Eostering. 

J~ 2 Paper presented at annual meeting of American Educational Research Association (AERA) in 
q ~Z New Orleans, LA, April 4 - 8, 1994, 

ERIC 3 authors gratefully acknowledge the contributions to this research of Armin Hollenstein, 
h^msI Margaretha Hofstetter, and Andreas Schmid. 2 



result of the tatter's activity is a detector model or the anticipation of the text to-be-written. The 
component "£m& iStioj] of th» ^mnntic DeeoStru^". on the other hand, constructs the deep 
structure which semantical^ constitutes the text. It does this by recalling suitable knowledge 
elements (idea generation) on the basis of the results of the task analysis from internal (memory) and 
external sources (illustrations, books, media etc), and by relating these elements with one another 
with the aid of appropriate relation concepts. The component TflDQUQOP Coding and Formulating 
nfth fl surface Structure" has two functions. On the one hand, it determines the order of thoughts for 
the linear surface structure of the text which appears in seqjences (chronology). On the other hand, 
it generates the correct, rhetorical-stylistic suitable surface structure of the text. The component 
■Fvtgrnm Reorientation" represents the results of the activities of the mentioned components 
externally. It presents, for example, the result of the relational linking of the construction of the 
semantic deep structure in a network type of form; it adheres to the result of the imposition of 
chronology a hierarchical list of micro and macro propositions; it represents the results of the 
syntactizing as a sequence of linguistic surface sentences. The " Test Compone nt" finally examines, 
in a variety of ways, whether conditions which have been attained at that point and those to be 
attained correspond. Does, for example, the detector model which functions as a text anticipation 
correspond to the text production task in question? 

Just as the art of playing well together exists in an orchestra in order to interpret music in well-coordi- 
nated interaction between the musicians and the conductor and in the disciplined collaboration of 
individual musicians, so the crucial point in the outlined text production model exists in the sensible 
coordination of individual main components in order to generate the text product. The task of the 
Executive Component is to provide this coordination. 
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3. Hypotheses and Subjects 

The hypothesis to be tested was whether 

0) mediation of metacognitive knowiedge of writing in those domains where the students most 
difficulties were spotted by the diagnosis 4 , 

(2) the training of executive procedures in relation to this know.edge. combined w,th 

(3) the mediation of text structure elements of expository and argumentative kinds of text, and 

(4) the training cf (1), (2), and (3) in real writing tasks would 

fa) help student; gain a better understanding of how to cope with writing an 
argumentative or an expository text, 

(b) give students a more effective approach in handling writing tasks v and 

(c) result in higher guality of written compositions. 

90 high school students (grade 1 0) participated in the study which lasted for about six months and 
consisted of about 60 lessons. 

4 Contents of the Intervention 

,n the intervention two kinds of training were provided: a process-oriented and a product-oriented 
training. 

The process-oriented training consisted of eight moduls and one executive accord.ng to the 
-Orchestra Model" of Text Production: (1) m^m^nsn^^ analyzing the writing task from the 
perspective of the writer's own understanding of the writing task, (2) '.nm^mn^Qmimom-. 
generating knowledge elements from memory or from external sources, (3) WH «i HQn "«** 
relating the generated knowledge elements with one another to produce the semant,c deep 
structure of the text to-be-written, (4) cixonol^^ imposing a chronology on the constructed 
semantic deeo structure aimed at determining the most convincing "path through the constructed 
semantic deep structure" in order to linearize this structure in respect to the linear or sequenced form 
of the text surface structure. (5) tQur^mi^^mOJI^. producing surface structure 
sentences in order to express the propositions of the semantic deep structure in the order of the 
imposea chronology, (6) fitfjDQdul; testing whether the (p-ovisional) text products produced so far 
correspond to the text anticipation; (7) mprewitc^ mocM= providing representation means for 
the external representation of the results of different subprocess: iconic/symbolic representation for 
representing generated ideas, nerworir representation for representing the constructed semant,c 
deep structure, hierarchical list representation (comparable to an outline) for representing the 
sequenced macro and micro propositions as the result of the imposing of a chronology on the 
semantic deep structure. (This representation served as an aid for producing the surface structure of 
the text to be represented as written text on a sheet of paper.); (8) r^QnJEQdu!: revs.ng the 
produced surface structure text in relation to content and form. 

6 

4 Those difficulties concern: (1) organization of the text production process. (2) analysis of the 
wZg SSvel set in relation. (4) imposition of a chronology on the — 
deep structure, and (5) different subcomponents of the test component (BAER et al. 1993). 



Based on students' difficulties in text production spotted by the diagnosis part of the research 
project (see BAER et al. 1993) the focus of the pro-ess-oriented training was on modulf . l), Ql C4X «>)■ 
m. and on executive procedures in order to train subjects' continuous conscious switches back 
and forth among the subprocess of writing distinguished in the "Orchestra Model" of Text Production, 
To help subjects gain insight into the subprocesses of writing represented by the moduls and the 
executive, as well as to gain insight into the text structure characteristics of expository and 
argumentative kinds of text (text organization), the so-called TgxPrpF-Kit was developed. For each 
modul lit^ontalhp the executive, and the characteristics of expository and argumentative text 
g^neans and aids /or supporting the subjects' learning process. When writing texts the TexProF-Kit was 
used as an external support for the subjects' production of text. Subjects worked with the kit all over 
the intervention, including all of its writing sessions. Last but not least, the kit also served as a help for 
students' internalization of the trained process- and product-oriented aspects of the intervention. 
In addition, in the middle of the intervention n professional writer modeled how he produce? text . 
What he said about producing text was related by members of the research group to the 
subprocesses of writing distinguished in the "Orchestra Model" of Text Production. Further, in a role 
play type of game where each role represented one subprocess of writing according to the 
"Orchestra Model" of Text Production, modeling of th e ■ su bpr ocess es of writing and coordination o f 
them b y on executive was provided by members of the research group. (By the end of the training, 
subjects played this game themselves.) In addition, reflections on process and product (expository 
and argumentative text) characteristics were conducted throughout the intervention. To support 
subjects' motivation and to provi de feedb ack from a real-live audience for them, a public 
presentation with a real audience (invited peers, teachers, parents) of the best texts written by the 
subjects was arranged. 

Almost all the time students worked in pairs (cooperative learning). In adc'ltion. most of the time each 
pair was accompanied by one member of the research group who understood him/herself as a 
mentor resoeotivelv a iutor who. on reguest. gave advice related to the specific writing task being 
worked on by the pair, and to whom guestions concerning process and product of writing in general 
could be asked. Finally, every time a text was being written, the members of a pair were reguested 
to anticipate with each other what they were going to do next within the writing process, what kind of 
mental activity this step consisted of. and to observe how much time the pair would spend on each 
specific step. Each pair continuously protocoled their writing activities and their duration in minutes in 
what we called a drive's respectively writer's logbook. 

All this was done ! n order to support metaccgnitive thoughts as well as to make a representation 
available of the mental processes gone through by the pair for the discussion of its decisions and 
activities with the mentor. Reflections on writing problems of general interest and possible solutions 
for them took place in plenum discussions . 

The product-oriented training provided subjects wHh main characteristics (text organization) of 
expository and argumentation type of texts according to BONATI (1990). To support learning in Ihe 
product-oriented training descripti ons of the characte ristics of expository and grqumentcjlonjyaa 



£Ue2fiJafi[ ^ which could be consulted during the P-oduction o. either on 

expository or an argumentative text. 

5. Measurement 

,n order to Investigate the effects of the intervention, severe, tests and evaluotion procedures were 
developed and applied: 

m VIGNETTE: Vfcnettes provided subjects with probiem situations which often occur ,n wntmg .n 
order to see whether subjects would handle the problem situations differently after the 
intervention than before (declarative metacognitive Knowledge): "In comparfcon to thinking- 
alouds or retrospective reports, the vignettes represent a viable means of elicitmg 
information about metacognitive knowledge by asking students to discuss and demonstrate 
on concrete tasks what the hypothetical student should do and explain why ..." (ENGLERT et 
al. 1988. 21). 

(2) DYADIC INSTRUCTION: Video-recording of a tutor's advice to a tutee in a dyadic text 
production situation allowed us to see how subjects who acted as tutors advised a tutee (a 
student from a parallel class which was not involved in the intervention) on how to cope w.th a 
text production task before and after the intervention (procedural metacogn.tive 

knowledge). _ no/N . 

(3) ESTIMATED PREWRITING TIME: Dividing up a hypothetical amount of 100 minutes (- 100.) by 
naming the kind of activities within the overall writing pocess attention should be paid to. and 
estimating how much time should be allocated to each of the distinguished subpocesses. 

(4) REAL/EFFECTIVE PREWRITING TIME: Measurement of the time being used by a writer before 
s/he starts to formulate surface structure sentences to povide data on whether subjects 
allocated more time for pewriting activities after the intervention. 

(5) QUALITY OF A TEXT PRODUCT: Evaluation of the quality of compositions which were written 
before and after the intervention also examined the intervention effect. 

(6) BRAND EMOTION SCALE FOR WRITER: Data of the Brand Emotion Scale for Writers (BRAND 
1984) which was translated into German language and was applied at the beginning of the 
sessions in which the pe- and post-test compositions were written gave insight into poss.ble 
influences of the intervention on students' emotions in writing. 

(7) QUESTIONNAIRE: A questional containing questions about what students find difficult, 
respectively not difficult concerning the poduction of texts at school were administered in 
order to judge the intervention's influence in this respect. 

(8) ACHIEVMENT MOTIVATION TEST: Finally, an achievment motivation test was administered at 
the beginning of the intervention. 

Tests and evaluation procedures (1) - (7) were used before and after the intervention. 
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6. Results Q 

The results to measurements (1) - (4) only are pesented below. 



Measurement 1 Vignettes: Declarative Knowledge 



Vignettes provided subjects with problem situations which often occur in writing in order 
to see whether subjects would handle the problem situations differently after the 
intervention than before. 
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Measurement 2 Diade: Procedural Knowledge 



r 



Translation: Vor Schreibbeginn * prevailing Nach Schreibbeglnn = while writing 



Kontroitgrp =. Control Group / Versuchsgrp = Experimental Group / V * Vo rlest = Pretest / N 



, Nochtest = Post test 



DIAD1C INSTRUCTION: Video-recording 
of a tutor's advice to a tutee in a dyadic 
text production situation allowed us to see 
how subjects who acted as tutors 
advised a tutee (a student from a parallel 
class which was not involved in the 
intervention) on how to cope with a text 
production task before and after the 
intervention (procedural metacognitive 
knowledge). 
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7. Conclusion 

Subjects who participated in the intervention dispose of a much better metacognitive knowledge 
base of text production (declarative knowledge) than subjects of the control group. Their views on 
how to organize the writing process significantly approached those of adult expert writers. In terms of 
the "Orchestra Model" of Text Production, subjects of the intervention group pay sigrficantly more 
attention to (1) the analysis of the writing task, (2) the construction of the semantic deep 5<i jr\jre, 
(especially the global or text related macro structural set in relations instead of local or sentence 
rotated micro structural set in relations which take place when the propositions underlying surface 
level sentences are constructed). Other improvements concern (3) the imposition of a chronology 
on the semantic deep structure, (4) the repertoire of external representation means for representing 
intermediate results of the text production process, and (5) the evaluation of the evolving text. 
Subjects of the intervention group not only possess more elaborate declarative knowledge, but they 
actually applied it in real writing situations as well (procedural knowledge). Firstly, in a dyadic 
instruction situation supervised by the experimenters, subjects of the intervention group made use of 
their acquired metacognitive knowledge while advising a tutee on how to cope with a text 
production task. Secondly, their time for prewriting activities is significantly longer than that of the 
control group, both estimated and effective. However, left on their own the subjects of the 
intervention group did not make as much use of their new knowledge as they did under supervision, 
as results not presented in this paper show, indicating that still more training in the autonomous 
application of available metacognitive knowledge is needed than was possible in the time allowed 
for the intervention by the involved high schools. 
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